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Ideally, neuronal functions would be studied by performing experiments with unconstrained animals whilst 
they behave in their natural environment. Although this is not feasible currently for most animal models, 
one can mimic the natural environment in the laboratory by using a virtual reality (VR) environment. Here 
we present a novel VR system based upon a spherical projection of computer generated images using a 
modified commercial data projector with an add-on fish-eye lens. This system provides equidistant visual 
stimulation with extensive coverage of the visual field, high spatio-temporal resolution and flexible stimulus 
generation using a standard computer. It also includes a track-ball system for closed-loop behavioural 
experiments with walking animals. We present a detailed description of the system and characterize it 
thoroughly. Finally, we demonstrate the VR system's performance whilst operating in closed-loop 
conditions by showing the movement trajectories of the cockroaches during exploratory behaviour in a VR 
forest. 

A traditional approach for studying neuronal mechanisms is to securely fix, anesthetize and/or dissect 
animals to allow stable electrophysiological recordings to be made whilst they are presented with sim- 
plified sensory stimuli. More complex stimuli with naturalistic spatio-temporal structures introduced as 
an improvement upon the experimental paradigm 1 " 7 are now acknowledged to be essential for gaining a more 
complete understanding of the sensory processing. In addition to the stimulus properties, sensory processing is 
also known to be modulated by the behavioural state of an animal (see eg 8 " 14 ). Therefore, it would be beneficial to 
carry out experiments in minimally constrained conditions and in naturalistic sensory environments, where 
animals can affect the environment through their own actions (e.g. walking). 

There are numerous examples of neurophysiological experiments in awake but constrained animals. One 
example of such a controlled experiment is the classical opto -motor paradigm used to study the visual behaviour 
of tethered insects when they are either walking on a track-ball, or flying attached to a torque-meter 15 . Because 
experiments in freely moving animals are still mostly limited to the larger animal models (see eg 16 " 18 ), virtual 
reality (VR) environments have been recently developed and introduced to the experimental set-ups to provide 
more naturalistic but well controlled settings 19 " 26 . 

We present a novel VR system that is based on a commercial data projector and a custom add-on fish-eye lens 
that projects images to the inner surface of a sphere. It also includes a track-ball to enable closed loop experiments 
in walking animals. The entire system is computer controlled for flexible stimulus control and easy integration 
with electrophysiological and behavioural experiments. 

Results 

The goal of this study was to develop a virtual reality (VR) system suitable for studying the processing of visual 
information in animal models that possess a fast visual system with vast visual field, such as flying day-active 
insects. Therefore, following design requirements were set: (1) coverage of a large field of view; (2) spatial 
resolution better than 1° when observed from the animal's point of view 27 ; (3) image update rates above 100 
Hz and no flicker below 200 Hz; (4) bright illumination up to day- light levels; (5) contrast performance within the 
range of natural environments; (6) flexible stimulus generation software that runs on a standard computer; (7) 
implementation of closed-loop behavioural paradigms. 
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The VR environment that we developed is a spherical projection 
system, where a data projector is used to display computer generated 
images on the inner surface of the sphere (Fig. la,b). To achieve high 
image refresh rate required for the animal models with fast vision, the 
projector was modified to operate with 360 Hz in greyscale mode 
(see Methods). Previously described mirror-based projection sys- 
tems 20 ' 21 ' 28 were used as a starting point for the optical design 
(Fig. lc,d). However, they were found to be unsuitable for the system 
because of the large projection angle, drawing capability require- 
ments and the mirror blocking a large part of the visual field. We 
were not able to verify if these limitations were specific to our sub- 
optimal mirror design or whether it is inherent limitation to the 
mirror-based approach. This is because the earlier descriptions of 
such systems 20 ' 21,28 do not provide any simulated or measured data 
about the drawing capability or image quality on the projection 
surface. Instead of a mirror-based approach, a fish-eye type lens 



projection was selected that has not to our knowledge been described 
earlier for spherical projection systems (see also 29 for early account of 
lens-based projection on to a cylindrical screen). The fish-eye lens 
can be used to project images over the whole spherical surface when 
placed at the top (Fig. le). The animal observes the VR environment 
from the centre of the sphere, which covers 65 % of the full visual field 
equidistantly ( — 135 to 135 degrees in azimuth and —64 to 57 degrees 
in elevation; Fig. 2a). It should be noted that areas used for the 
instrumentation overlap with locations that animals cannot often 
see (such as below and behind them). 

As a measure of the spatial resolution of the VR the sizes of indi- 
vidual pixels were measured from the projection surface. The angular 
size of the pixels as observed from the animal's perspective were 
found to be ca. 0.8 degree squares at low elevations but became 
horizontally compressed towards higher elevations (Fig. 2b). This 
is attributable to the projection geometry where, at the extreme, 






Figure 1 | VR system and projection optics, (a) 3D model of the VR system showing projector with add-on lens, spherical projection surface, track ball, 
microscope and micromanipulator, (b) Photograph of a behavioural experiment with the forest scene; cockroach is on a track ball tethered to a metal wire 
and it is circulating the forest edge, (c) Ray tracing simulations of the projection optics design with a flat mirror and an aspherical angular amplification 
mirror 20 ' 21,28 ; the mirror blocks ca. 45 degrees of the visual field, (d) Design with two aspherical mirrors 28 for angular amplification that blocks smaller 
visual field than in (c). (e) The fish-eye lens design. 
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Figure 2 | Projection area and spatial resolution, (a) Projection area shown in grey rectangle covers ca. 65 % of the full visual field, (b) Pixel size at the 
projection surface as a function of elevation; squares represent width and circles height of each pixel; grey squares represent the simulated RMS spot size of 
the add-on optics, (c) Simulated spots at the projection surface as a function of elevation for a point-like white light source; geometric and chromatic 
aberrations are seen as separation of red, green and blue colours. 



600 pixels are compressed to the ring surrounding the lens. However, 
it should be noted that the geometrical mapping of the image render- 
ing software displays images correctly on the surface in spite of the 
varying pixel density. At the highest elevations the pixels were also 
found to be vertically stretched, which can be attributed to the small 
incidence angle of the projecting light that caused partial reflection 
(Fig. 2b). The drawing performance of the projection optics was also 
simulated with optic design software to investigate its possible contri- 
bution to the observed image quality on the projection surface. In such 
simulation, image of an infinitely small point of white light on the pro- 
jection surface is calculated, which provides information on the spatial 
resolution of the optics and possible optical aberrations. The results 
showed that the drawing performance decreased from the ca. 0.28° 
root-mean-square (RMS) spot diameter at the equator up to ca. 0.5° 
towards the lower and higher elevations (Fig. 2b,c). The attained 
resolution is an order of magnitude worse than the —60 |im diffrac- 
tion limited theoretical performance boundary for the design. The 
simulations showed that the performance was reduced by the geomet- 
rical and chromatic aberrations, which changed from a spherical 
aberration at the low elevations to dominantly an astigmatism type 
at the equator and higher elevations (Fig. 2c). These aberrations were 
difficult to correct completely through the lens optimization because 
of variation in the distance as a function of elevation from the lens to 
the surface of the sphere. However, the drawing performance of the 
add-on lens still exceeds the projector's pixel resolution at the most 
part of the visual field, which acts as a limiting factor for the spatial 
resolution in the system (Fig. 2b). 



The surface brightness and contrast of the displayed images were 
measured using a spectrometer coupled to a fibre optic probe (see 
Methods). The spectrum of the greyscale images reflected from the 
projection surface shows several distinct peaks over the visible range 
and represents the "spectral fingerprint" of the projector lamp 
(Fig. 3a). The maximum surface brightness, i.e. the maximum irradi- 
ance of the projection surface, was measured to be 4.0 W/m 2 , which 
corresponds roughly to the irradiance on the earth's surface during a 
cloudy day. Surface brightness was found to vary as a function of 
elevation, which was expected because of the increasing pixel density 
at the higher elevations (Fig. 3b). The stimulus brightness was also 
measured for increasing input signal levels, which resulted in a typ- 
ical nonlinear relation, the gamma curve (Fig. 3c). The input versus 
brightness curve was linearised using the gamma correction and an 
additional software calibration was applied that partially corrected 
the elevation effect in brightness. It should be noted that any remain- 
ing smooth and moderate brightness gradients are not expected 
to significantly affect visual behaviours (see eg 7 for the optic flow 
processing). The Michelson contrasts of the projected images were 
characterized by measuring the irradiance values between a bright 
patch of various sizes on a dark background (and vice versa). The 
contrast was very high with values close to 1 for small bright patches 
on the dark background and decreased steadily with an increasing 
ratio of bright vs. dark areas, until becoming saturated at ca. 0.2 (e.g. 
0.65, 0.35 and 0.2 for bright to dark area ratios of 1/10, 1/3 and 2/3, 
respectively; Fig. 3d). This decrease in contrast is attributable to 
the light integrating nature of the diffusively reflecting spherical 
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Figure 3 | Characterization of the surface brightness and contrast, (a) Spectrum of the grey scale image at the projection surface for 100% brightness full 
field stimulus, (b) Projection surface irradiance as a function of elevation for 100% brightness full field stimulus, (c) Projection surface irradiance as a 
function of input intensity level; line shows fit of the gamma curve with the gamma value of 2.56. (d) Contrast as a function of the area of the 100% 
brightness stimulus patch at dark background or dark patch at 100% bright back-ground. 



projection surface, which is an unavoidable consequence of the spher- 
ical projection geometry. Importantly, the measured image contrasts 
are still well within the range of naturally occurring contrasts 30 . 

The temporal performance of the VR system was characterized by 
monitoring the projected stimuli with a photodiode. Full field stimuli 
of an intermediate and full brightness of a ca. 6 ms long sequence of 
three experimenter controlled frames were presented, followed by 
a ca. 2 ms white segment controlled by the projector hardware 
(Fig. 4a; see Methods). Fast intensity fluctuations within each frame 
are caused by the digital encoding of the light intensity that is imple- 
mented in the projector hardware. However, this fast fluctuation 
takes place in micro-second time scale, too fast to be perceived by 
any known visual system, and becomes integrated in the visual system 
as a constant intensity level. The power spectrum of the data was 
calculated for the full field stimulus of maximum brightness, which 
revealed a 120 Hz flicker attributable to the uncontrollable white 
segment (Fig. 4b). Data from the stimulus with intermediate bright- 
ness showed further increase in the flicker (Fig. 4a), which leads to the 
corresponding increases in the power spectrum at 120 Hz and its 
harmonics (Fig. 4b). Note that the digital implementation of the light 
intensity encoding leads to signal analogous to the digital white noise, 
which gives rise to flat power spectra. 

Intracellular in vivo recordings were carried out in blowfly 
(Calliphora vicina) photoreceptors, insect with one of the fastest 
known visual system 31 " 33 . Our logic was that if their photoreceptors 
do not respond to the rapid fluctuations in the light intensity attrib- 
utable to the digital light intensity encoding or the 120 Hz flicker 
associated with the white segment, the VR can be considered to be 



suitable for any animal model with fast vision. Step-like full field 
stimuli from darkness to the varying brightness levels were used to 
elicit photoreceptor responses. No response to rapid light intensity 
encoding fluctuations was observed but, after the initial transient 
response, the photoreceptor's membrane potentials were locked to 
the 120 Hz flicker (Fig. 5a). The flicker responses were largest at 
intermediate brightness values, which resulted from the proportion- 
ally larger intensity fluctuations in the stimulus (Fig. 5b). To address 
this problem the 2 nd generation version of the same projector model 
was used, in which the manufacturer had removed the white segment 
by modifying the projector's firmware (see Methods). Intracellular 
photoreceptor recordings made using the new projector model to 
present the stimulus showed no 120 Hz ripple in the step responses 
(Fig. 5d,e). The differences in the voltage waveforms between the two 
projectors were attributable to the reduced background light and 
higher brightness of the stimuli in the measurements with the 2 nd 
generation model. Analysis of the power spectrum from responses to 
steady light using the older and new projector model also showed 
that peak in the photoreceptor voltage response power related to 
the 120 Hz flicker had decreased by ca. 10 4 orders in magnitude 
(Fig. 5c,f). Therefore, it can be concluded that the developed VR 
equipped with the 2 nd generation projector model enables stimulat- 
ing even the fastest visual systems with high 360 Hz frame rate and 
without flicker artefacts. 

Finally, cockroaches (Periplaneta americana) were used as an ani- 
mal model to demonstrate the suitability of the VR system for beha- 
vioural studies with walking behaviour. Although not an animal with 
fast vision the cockroach was selected because it has robust walking 
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Figure 4 | Measurements of the stimulus intensity flickering, (a) Light 
intensity fluctuations measured for the full field stimuli with brightness of 
100% (top) and 50% (bottom). Coloured bar represents ca. 2 ms colour 
segments used to encode the sequential image frames and white 
corresponds to white segment; note that intensity varies from dark to full 
brightness, (b) Power spectra of the 0% (black), 50% (blue) and 100% 
(red) brightness full field stimuli show large power peaks at 120 Hz and its 
harmonics that are associated with the white segment. 

behaviour on the track-ball and it was readily available in the labor- 
atory. The visual system of cockroaches is too slow for them to detect 
the 120 Hz flicker 34 . Therefore, the VR system with the 1 st generation 
projector installed was used for these experiments. The cockroaches 
were tethered from the pronotum and placed on a track-ball system, 
which enabled them to navigate in the VR forest (Fig. lb; 
Supplementary video SI). Although the track-ball weight exceeded 
the optimal weight for the cockroach 35 , they had no difficulties in 
rotating the nearly frictionless track-ball. Each experiment started 
in the middle of the forest (Fig. 6a,b). The trees were disproportio- 
nately small compared to a cockroach, but they can still be consid- 
ered as concrete visual objects. The cockroaches remained active in 
the VR for extended periods of time, typically showing burst of 
walking activity interspersed with periods of inactivity (Fig. 6c,d). 
While approaching a tree the cockroaches would typically antennate 
towards it, presumably trying to establish a tactile contact with the 
visual object (Supplementary video SI). Typically, they avoided 
the trees, walking around them but occasionally, possibly the lack 
of tactile feedback from the antennae, caused them to continue to 
approach the tree, eventually walking through it. This outcome was 
not prevented by the software. This behaviour can be seen in the 
track plots (Fig. 6a,b) and in the histograms of cockroach distance to 
the tree centre (Fig. 6e,f). Note that especially the other individual has 
spent lots of time at the distance close to the tree trunk (Fig. 6f). At a 
larger scale the cockroaches fixated on the darkness surrounding the 
forest and headed towards the forest edge along a fairly straight route 



(Fig. 6a,b). Once at the edge (Fig. lb), they typically started to follow 
it, often walking around the perimeter of the virtual world several 
times (Fig. 6a,b; Supplementary video S2). None of the cockroaches 
returned to the forest after they had found the dark forest edge, which 
is not surprising considering their innate preference for dark areas in 
the environment. 

Discussion 

We have successfully developed a VR system for animal models that 
have fast vision, such as day-active insects. The system we developed 
provides good spatio-temporal performance and covers most of the 
relevant parts of the visual field, which is known to be essential for the 
optic flow dependent behaviours in insects 15,26 ' 36 . The spherical VR 
also has equidistant projection geometry, which removed need for 
the real-time perspective distortion corrections required with e.g. flat 
computer screens 26 , which could become a limiting factor for the 
spatio-temporal performance in high frame rate system such as 
one presented here. The VR system can also produce stimuli with 
equivalent brightness to a cloudy- day and contrasts comparable to 
the natural environment. Finally, it is controlled with a standard 
computer and software that provides flexible stimulus generation 
and control possibilities. These technical features coupled with dem- 
onstrable success in both behavioural and electrophysiological 
experiments (see also 37 ) allow us to conclude that the system is suit- 
able for presenting animals with the behaviourally relevant and 
naturalistic stimuli. Further details of the design, including manufac- 
turing instructions, are available from authors upon request to enable 
system replication. 

A temporal flicker problem was identified during the system char- 
acterization, which was also verified in electrophysiological record- 
ings from blowfly photoreceptors to be detectable by animals with 
very fast vision. However, this problem was avoided by replacement 
of the original projector with the 2 nd generation model, which is 
commercially available from the projector manufacturer. Because 
the 1 st generation projector was already fully adequate for the cock- 
roach and several other animal models used in the laboratory, we 
decided not to replace it with the newer model but instead build a 
second VR system based on the 2 nd generation model for the animals 
with faster vision (work in progress). The main remaining limitation 
with the developed VR system is the inability to generate colour 
stimulation, which was compromised to increase the frame rate to 
360 Hz. However, many visual behaviours are not dependent upon 
colour information (e.g. optic flow processing 15 ' 36 ' 38 ) and the colour 
filters can be used in the lens assembly for simple full field manip- 
ulation of the spectral content of the stimuli. 

Other approaches have been described in the literature for imple- 
menting VR environments, but detailed comparison to our system is 
not possible because lack of quantitative data on the performance of 
these VR system in the published results. A LED -based virtual reality 
system has been presented that also covers a large fraction of the 
visual field and in which the stimulus is controlled through a modi- 
fied VGA graphic card 7 (see also 39 ). Its main advantages are the 
flicker free image with high brightness but, on the other hand, its 
disadvantages include a limited spatial resolution, as well as require- 
ments for complex custom instrumentation and control software. It 
should also be noted that our VR system already achieves the day- 
light level brightness, which can be increased further when using the 
2 nd generation projector that has brighter lamp in it. 

Data projector based VR systems have also been described for 
rodents, which include the track-ball system 20,21 . However, their tem- 
poral performance is too low for animals with fast vision, which 
would see the typically 60 Hz frame rate as high contrast flicker 
(see also 19 ). In addition, based on our simulations, the mirror based 
projection optics used in these systems is expected to produce lower 
image quality than the novel fish- eye design of our VR system. 
Therefore, the lens based design is expected to provide significant 
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Figure 5 | 120 Hz is detected by the blowfly photoreceptors, (a) Photoreceptor voltage responses with 1 st generation projector for a full field step stimuli 
from darkness to varying brightness from maximum; each trace is an average of 10 trials; stimulus is shown below, (b) Photoreceptor voltage response 
(black) and photodiode signal (red) with the 1 st generation projector for full field stimulus of the constant 100% (top) and 18% (bottom) brightness; 
photodiode signal off-set and scale is arbitrary, (c) Power spectra of the photoreceptor voltage responses to full field stimuli with 100% (black) and 18% 
(red) brightness; the 120 Hz and its harmonics are clearly visible, (d)-(f) Similar measurements as in (a)-(c), but with the 2 nd generation projector; scale in 
the (d) and (e) are as in the (a) and (b), respectively; note that the residual flicker detected by the photodiode is too fast to be seen by the photoreceptors. 



improvement in the image quality of the spherical VR systems in 
general. A VR system was also recently reported that uses two custom 
DLP projector engines to create a panoramic field of view with back- 
projecting spherical surfaces 22 . It is reported to produce greyscale 
frame rates of up to 8000 frames/s in a binary mode, however, this 
corresponds to only 60 Hz frame rate when 8 bit intensity encoding is 
used as in our system. It also provides stimulation options for other 
sensory modalities but, for the visual stimulation, our system pro- 
vides more flexible stimulus control and comparable spatio-temporal 
performance with much simpler and more cost efficient imple- 
mentation. 

Our future method development work will focus on implementing 
multisensory stimulation possibilities into the VR. For example, an 
olfactometer will be included to enable stimulation of the olfactory 
and mechanosensory pathways. The VR based approach will be 
extensively used in our future works to replicate traditional arena 



or maze experiments in the VR, as well as to implement more com- 
plex experiments enabled by the easy real-time manipulation of the 
visual environment (e.g. a visual object that the animal has fixated 
can be easily moved to different location or modified by the appear- 
ance). Importantly, the behaving animals can be constrained in 
the VR to enable simultaneous electrophysiological measurements, 
which can be used to investigate the neuronal mechanisms behind 
the behaviours. 

Methods 

VR design. The system involves the projection of computer generated images onto 
the inner surface of a spherical projection screen using a data projector in 
combination with a fish-eye lens (Fig. la). An animal is placed in the centre of the 
sphere, which from the animal's viewpoint enables covering of the full visual field 
equidistantly with the screen. A sphere with 400 mm diameter was built from a glass 
fibre by laminating the fibres on top of a positive half-sphere mould. The two halves of 
the sphere were attached to each other and sections from the resulting full sphere were 
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Figure 6 | Cockroach exploratory behaviour in the VR environment, (a) Cockroach no. 1 and; (b) no. 2 exploring in the virtual forest; red crosses mark 
20 s time progression; circles mark location of the trees; world is dark outside the forest (see also Supplementary videos; note that videos are not from the 
data shown in the figure), (c) and(d) movement speed for the trajectories shown in (a) and(b) showing bouts of activity followed by inactivity periods, (e) 
and (f) histograms of the distance to tree centre for the data in (a) and (b); note that trees were rectangles with their larger dimensions shown in the 
histogram as grey bar. 



subsequently removed from the top and the bottom to accommodate the lens and the 
animal holder, respectively (Fig. la). In addition, a 90° section was removed from 
the back to provide access for a stereo microscope and micromanipulators required 
for the electrophysiology. The inner surface of the sphere was polished and coated 
with barium sulphate based paint (ODP97-1.0, Gigahertz- Optic GmbH) that forms a 



high-quality white Lambertian surface. This reduces directional reflections and 
increases surface brightness. 

Fish-eye type add-on lens was designed to be used in conjunction with the pro- 
jector's own lens (together called projection optics). ZEMAX® (Zemax Development 
Corp) software was used for the optical design and optimization. The optical 
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properties of the projector lens were measured to allow it to be replaced by a thin lens 
equivalent in the optics design. At the image source, the projection optics was opti- 
mized to use the approximately 10.5 mm diameter circle of the projector's digital 
micromirror device (DMD), which corresponds to a circle of 600 pixels in diameter. 
This allows the system to take full advantage of the available resolution of the SVGA 
projector. The designed add-on lens assembly includes one catalogue singlet (KXP- 
189, Newport Corp.), a plane mirror, two custom doublets and two custom singlets 
(Fig. 7a,b). The effective focal length of the projection optics is 4.1 mm. The lens 
assembly also includes slots for placing optical filters (Fig. 7a), such as neutral density 
and colour filters. 

Animals with fast vision, such as flying insects, have a flicker fusion rate that 
exceeds the frame rate of the commercial data projector 27,3233 . A moderately priced 
digital light processing (DLP) type data projector was selected for the VR system 
(DepthQ®, Lightspeed Design Inc). It can produce 120 Hz frame rate with 24 bit 
colour reproduction and SVGA resolution. The colour filter was removed from the 
projector's image engine to harness the colour production for tripling the frame rate 
of 8 bit greyscale images to 360 Hz. Custom software was developed to control the 
image production, based on an open-source Ogre3d graphic rendering engine (http:// 
www.ogre3d.org/). The software runs with a standard computer and a Windows 
operating system (Microsoft Inc.). The rendering is based on a cube map with six 
cameras for each frame. The VR environment is created as a cube of specific size, 
where each camera is facing one of the inner faces of the cube. A geometrical trans- 
formation is included in the compiled VR control files that subsequently morphs the 
cube into a sphere. In addition, the control files include functional data that can be 
used to control aspects of the VR environment, such as moving objects or changing 
the viewpoint within the VR. The pixels that are not "seen" by the projection optics 
and the ones that would project to the sectors removed from the sphere or directly to 
the animal are set to black. The software creates greyscale images with 8 bit intensity 
encoding that are displayed sequentially on the colour channels in the order of blue, 
green and red to produce 360 Hz frame-rate. It should be noted that in the 1 st 
generation projector model the hardware implemented white channel always follows 
the red channel and its brightness is automatically determined, based on the three 
colour channels intensities. The white segment is eliminated in the 2 nd generation 
special model that was made recently available by the projector manufacturer (result 
of an independent development project; courtesy of Anthony Leonardo, Janelia Farm 
Research Campus, HHMI and Lightspeed Design Inc.). 

A track-ball was designed according to the previously described approach using 
computer mice and built to permit closed-loop behavioural experiments with the 
walking animals (Fig. 7c) 20 ' 21 ' 40 - 43 . it is placed on a heater platform that can control the 
temperature inside the VR system within a range of 20 — 40°C (Fig. lb). The trackball 
includes an air-supported hollow Styrofoam sphere with 93 mm diameter and 4.8 g 
weight (Fig. 7c), which is placed to the centre of the sphere (Fig la,b). The track-ball 
chassis is milled from PVC plastic. The animal is tethered and placed on top of the 
nearly frictionless ball. The ball weight is heavier than what would be optimal for 
matching its inertia to that of e.g. cockroach 35 , but this has not lead to difficulties in 
rotating the ball. Rotations of the ball are measured by two image sensors disas- 
sembled from an optical computer mouse (AMU45EU, Targus Group International 
Inc.). The image sensors (ADNS-2610) are integrated to the track ball chassis and 
connected to the VR controlling computer with the USB cables of the computer mice. 
The sensor frame rate is 1500 frames/s, resolution is ca. 0.078 degrees and the max- 
imum speed and acceleration are 0.3 m/s and 2.5 m/s 2 , respectively. This performance 
is sufficient for the typical experiments with walking insects (Fig. 7c,d), except for the 
maximum speed that may be exceeded e.g. during fast escape responses (~ 1 m/s in 



cockroach). In such cases, the measured movement and the subsequent VR control 
would be inaccurate. Rotations of the ball are streamed to the memory buffers of the 
mice and polled by the VR software through raw input interface of the MS Windows 
operating system at every vsync event associated with the frame rate update. The 
rotation values are transformed into the control commands for the VR, which enables 
calculating difference between two frames used to move the VR scene accordingly. In 
addition of the closed-loop control, the track-ball can also be used in the open-loop 
mode, where animal movements are measured but not used to control the VR 
environment. 

Technical measurements. Pixel diameters on the projection surface were measured 
from the varying elevations along the 135 degrees in azimuth. The measurements 
were done manually using a calliper and repeated several times to increase the 
reliability of the measurements (N = 6). Contrast and surface brightness 
measurements were made with a calibrated spectrometer (USB4000 UV-VIS, Ocean 
optics Inc). Spectrum and surface irradiances with varying brightness levels were 
measured using the full field stimuli. For the contrast measurements a white patch 
stimulus of varying size on a black background or black patch stimulus on a white 
background were used. The fibre optic probe (NA = 0.22) of the spectrometer was 
positioned either 20 or 1 54 mm from the surface of the sphere, or in the centre of it, for 
measuring the size of pixels, contrasts and brightnesses, respectively. The contrasts, c, 
were calculated according to the Michelson formula c = (I s — I b )/( I s +Ib) where I s and 
I b are the surface irradiance of the stimulus and the background, respectively. 

Stimuli were also measured with a photodiode. The photodiode signals were 
amplified and saved to a computer with a 50 kHz sampling rate. Because the 
photodiodes were only used to monitor temporal dynamics of the stimulus intensity, 
they were not calibrated leading to arbitrary output values. The data acquisition in all 
measurements were carried out with a data acquisition card (PCIe-6259, National 
Instruments Corp.) and a custom LABVIEW® (National Instruments Corp.) 
program. Power spectral densities were estimated in MATLAB® (Mathworks Inc.) 
using the Welch's method with a hamming window. 

Animal experiments. Blowflies (Calliphora vicina) were grown in a laboratory stock 
that is regularly refreshed with animals obtained from the Blades Biological Ltd, UK. 
All data presented was collected from the female flies. Flies were fixed on a piece of 
microscopy glass with a mixture of a paraffin and beeswax. Legs and antennae were 
removed and wounds sealed with the wax to prevent drying. A small hole was cut in 
the dorsal part of the cornea of the left eye for the electrode insertion. Sharp glass 
capillary microelectrodes were manufactured using a laser puller (P-2000, Sutter 
Instrument Company Inc.). An Ag/AgCl reference electrode was placed in a small 
opening cut in the fly's abdomen. The glass capillary electrodes were driven to the eye 
with a custom piezo manipulator (courtesy of Sensapex Ltd.). Experiments were 
performed on the cells with dark resting potential below — 60 mV and an input 
resistance of at least 15MQ 44 . The photoreceptors were stimulated using full field 
flashes of varying brightness. The experiments shown in Fig. 5a-c were performed 
using the 1 st generation projector that is integrated to the VR system and those in 
Fig. 5d-f with the 2 nd generation model projecting to a planar screen coated with the 
same paint as in the spherical screen. Measurements were made from four animals 
(for cells N = 12) and data was acquired at 4 kHz sampling rate. 

Adult male American cockroaches (Periplaneta americana) from a laboratory 
stock were used for the behavioural experiments. The tip of a wire holder was fixed to 
the pronotum of a carbon dioxide-anesthetized cockroach with a mixture of beeswax 
and resin. The cockroach was mounted on the track ball and care was taken to adjust 



a 




90 mm R ■ 70,5 



Figure 7 | Fish-eye lens and trackball schematics, (a) Schematic cross section of the add-on fish-eye lens assembly; colour filter slot is highlighted in grey 
colour, (b) Custom lenses in the assembly shown in more detail; R refers to surface curvature of the spherical lens, (c) Section through a 3D wire model of 
the track-ball. Pressure port at the lower part is for coupling of the air supply to provide low friction air cushion; one of the two sensors is shown in the 
cross section. 
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the animal's posture and elevation from the ball so that it could move as normally as 
possible. Each cockroach was allowed to recover from the anaesthesia and adapt to the 
experimental set-up for at least 15 minutes prior to starting the experiment, which 
was found to be sufficient time for the full recovery of normal activity level. The 
animals were not exposed to any stimuli during this time (i.e. VR was dark). 
The cockroaches were able to navigate freely in the virtual forest environment, 
including the black surround (Fig. lb). The forest was evenly lit without any shadows 
under the trees. 
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